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1 1 1 -12- 2003 

Method and Apparatus for transmitting watermark data bits 
using a spread spectrum, and for regaining watermark data 
bits embedded in a spread spectrum 

The invention relates to a method and an apparatus for 
transmitting watermark data bits using a spread spectrum, 
and to a method and an apparatus for regaining watermark 
data bits embedded in a spread spectrum, wherein the water- 
mark signals are arranged at frequency bands where an audio 
signal is notch filtered. 

Background 

•Watermarking' means imperceptible insertion of information 
into multimedia data, e.g. audio data and/or video data. The 
insertion of additional information data, such as a number 
or a text, into multimedia data is performed through slight 
modification of the original multimedia data. Watermarking 
can be used for e.g. copyright protection, labelling (e.g. 
URL of a site or a site's logo), monitoring, tamper proof- 
ing, or conditional access. 

Applying 'spread spectrum' in a (RF) communications system, 
means that a small baseband signal bandwidth is intention- 
ally spread over a larger bandwidth by injecting or adding a 
higher- frequency signal, or spreading function. As a direct 
consequence, the energy used for transmitting the signal is 
spread over a wider bandwidth, and appears as noise. 
Spread spectrum technology and the related inserted or added 
information signal can be used for implementing watermarking 
of e.g. digital audio signals, whereby the spread spectrum 
can use the complete audio spectrum from 0Hz to one half of 
the sampling frequency. This spectrum carries the informa- 
tion of one bit. 

In a modification of such systems shorter spread spectrum 
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sequences are used leading to band limited spread spectrum 
signals, so that several ones of the band limited spread 
spectrum signals can be added at different centre frequen- 
cies to the audio spectrum, at which centre frequencies the 
original audio signal has been notch filtered, in order to 
increase the bitrate of the watermark signals and/or to pre- 
vent attacks on the watermarked signals. In this watermark 
system the spread spectrum signals are modulated on a car- 
rier. 

The watermark signals that are embedded in the audio signal 
should not be audible. But if the original audio signal 
spectrum has no sufficient energy level near a modulation 
frequency, the watermark signal will become audible. There- 
fore the watermark signals are inserted only in those fre- 
quency bands where the audio signal has substantial power, 
based on psycho -acoustic laws. 

A known processing for retrieving at receiver or decoder 
side the watermark signal information bit from the spread 
spectrum is convolving the received or replayed spectrum 
with a spreading function or sequence that is time -inverse 
with respect to the original spreading function or sequence, 
which kind of processing is also called 'applying a matched 
filter 1 . If BPSK modulation was used for applying the spread 
spectrum function, the output of this process is ^a peak at 
the middle of the sequence of correlation overlap-add val- 
ues, whereby the sign of such peak represents the value of 
the desired watermark signal information bit. If QPSK was 
used two peaks will be present in the sequence of correla- 
tion values, whereby each peak represents one bit value. 

Invention 

Because in prior art decoders the decoder has no a-priori 
information about which watermark signal carrier or carriers 
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are currently available in a current audio frame, the de- 
coder must check for all possible carrier frequencies in all 
candidate frequency bands whether a carrier is actually pre- 
sent. The disadvantage of this solution is that such check- 
5 ing for all possible carrier frequencies demands high proc- 
essor power, i.e. leads to a multiplied MIPS (million in- 
structions per second) demand. 

A problem to be solved by the invention is to keep the ro- 
10 bustness of modulated- carrier spread spectrum systems while 
reducing the required processing power for demodulating or 
decoding the watermark signal information bits. This problem 
is solved by the methods disclosed in claims 1, 2, 3 and 4. 
Corresponding apparatuses which utilise these methods are 
15 disclosed in claims 4, 5, 6 and 7, respectively. 

In some watermarking system applications, in which a certain 
encoder/decoder processing delay is acceptable, a forward- 
looking psycho-acoustic can be implemented, which means that 

20 at a given time instant, i.e. for a current audio signal 
frame, it is already known at encoder side in which fre- 
quency band or bands in the following audio signal frame the 
next watermark signal or signals, respectively, can be em- 
bedded. If this frequency band information is signalled in 

25 advance, i.e. is transmitted or transferred already together 
with the frame data for the current frame, the decoder knows 
before processing the following audio signal frame which 
carrier frequency or frequencies are occupied and must be 
used for the corresponding carrier demodulation, and which 

3 0 carrier frequencies need not be checked and demodulated. 

The advantage of such inventive signalling-in-advance is a 
significantly reduced processing power or MIPS demand in the 
decoder. If on average e.g. 2 frequency bands out of in to- 
35 tal e.g. 6 candidate frequency bands are used, the process- 
ing power requirements will amount to about one third only. 
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On the other hand, the robustness against all kinds of at- 
tacks, and the inaudibility of the watermark signals, can be 
increased by providing in total an increased number of can- 
didate frequency bands, without need for more CPU power as 
compared to prior art technology. 

This inventive decoding processing works fine in case undis- 
turbed signal are received by the decoder. However, if the 
received input signals contain multipath or echo or rever- 
beration distortions , the convolved output signals will con- 
tain more than one peak per watermark signal information bit 
(i.e. per convolution result) to be decoded so that, e.g. 
depending on the amplitude or power of the distortion peaks, 
it is difficult or in many cases even impossible to retrieve 
the correct watermark information bits. 

Therefore an additional advantageous feature can be used. 
With respect to a watermark signal carrier-occupied fre- 
quency band in the current frame, according to the amount of 
the main echo delays or the mean echo delay, in a future au- 
dio signal frame, the time period of which frame correlates 
to that amount of echo delay, no watermark signal carrier is 
transmitted in the frequency band corresponding to that oc- 
cupied frequency band. Thereby the echo from the watermark 
signal carrier in the occupied frequency band in the current 
frame will occur at a frequency band in the future frame 
where no watermark signal carrier is present, and the number 
of watermark signal bit errors due to echoes caused by mul- 
tipath or reverberated reception conditions is substantially 
decreased. Preferably, the future audio signal frame is the 
audio signal frame following the current audio signal frame. 

The latter features can also be used without signalling in 
advance the future-occupied frequency band or bands, by us- 
ing a pre -determined pattern of differently occupied fre- 
quency band or bands in different audio signal frames, e.g. 
a regular pattern like staircase up (as depicted in Fig. 3) 
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or staircase down. 

In principle, the inventive method is Suited for transmit- 
ting watermark data bits using a spread spectrum, said 
method including the steps : 

- Modulating said watermark data bits on an encoder pseudo- 
noise sequence; 

- Modulating said modulated encoder pseudo-noise sequence 
on a carrier frequency; 

- Determining whether at one or more different candidate 
frequency band positions in a current frame of said audio 
signal the energy or amplitude level of said audio signal is 
such that it can mask one or more, respectively, of said 
modulated carrier frequencies and, if this is true, notch 
filtering said audio signal at the corresponding frequency 
band positions and inserting at this frequency or at each of 
these frequencies, respectively, said carrier frequency or 
one of said carrier frequencies, respectively; 

- Checking at which candidate frequency band positions in a 
frame following said current frame of said audio signal the 
energy or amplitude level of said audio signal is such that 
it can mask one or more, respectively, of said modulated 
carrier frequencies, and providing information about the lo- 
cations of these frequency band positions; 

- Transmitting or transferring data of said current audio 
signal frame carrying said watermark data bits together with 
the information about the locations of the frequency band 
positions to be used in said frame following said current 
frame of said audio signal. 

In principle, the inventive method is suited for transmit- 
ting watermark data bits using a spread spectrum, said 
method including the steps: 

- Modulating said watermark data bits on an encoder pseudo- 
noise sequence; 

- Modulating said modulated encoder pseudo-noise sequence 
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on a carrier frequency; 

- Notch filtering a current frame of said audio signal at 
frequency band positions which are arranged in a pre-defined 
pattern across the sequence of frames of said audio signal 
and inserting at this frequency band position or at each of 
these frequency band positions, respectively, in said cur- 
rent frame of said audio signal said carrier frequency or 
one of said carrier frequencies, respectively; 

- Transmitting or transferring data of said current audio 
signal frame carrying "said watermark data bits. 

In principle, the inventive method is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lated at encoder side on an encoder pseudo- noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
one of said carrier frequencies was inserted instead, and 
wherein a current audio signal frame carrying said watermark 
data bits was transmitted or transferred together with in- 
formation about the locations of the frequency band posi- 
tions used for said carrier frequencies in a frame following 
said current frame of said audio signal, said method includ- 
ing the steps: 

- Receiving and synchronising said transmitted or trans- 
ferred audio signal; 

- Demodulating for a current audio signal frame said car- 
rier frequency or said carrier frequencies, respectively, 
thereby using said information about the location or loca- 
tions of the frequency band position or positions used for 
said carrier frequency or frequencies, respectively, which 
information was attached to the data for a previous frame of 
said audio signal; 

- Convolving said current frame of data of said audio sig- 
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nal with- a time-inversed version of the encoder pseudo-noise 
sequence / 

- Determining from the sign of the peak or the peaks of the 
corresponding convolution result the value of a bit of said 

5 watermark data. 

In principle, the inventive method is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lo lated at encoder side on an encoder pseudo-noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
15 one of said carrier frequencies was inserted instead, 

whereby said frequency band positions were arranged in a 
pre-defined pattern across the sequence of frames of said 
audio signal, said method including the steps: 

- Receiving and synchronising said transmitted or trans- 
20 f erred audio signal; 

- Demodulating for a current audio signal frame said car- 
rier frequency or said carrier frequencies, respectively, 
thereby using the information about said pre-defined pat- 
tern; 

25 - Convolving said current frame of data of said audio sig- 
nal with a time-inversed version of the encoder pseudo-noise 
sequence ; 

- Determining from the sign of the peak or the peaks of the 
corresponding convolution result the value of a bit of said 

30 watermark data. 

In principle the inventive apparatus is suited for transmit- 
ting watermark data bits using a spread spectrum, said appa- 
ratus including: 
35 - Means for modulating said watermark data bits on an en- 
coder pseudo-noise sequence; 
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- Means for modulating said modulated encoder pseudo-noise 
sequence on a carrier frequency; 

- Means for determining whether at one or more different 
candidate frequency band positions in a current frame of 
said audio signal the energy or amplitude level of said au- 
dio signal is such that it can mask one or more, respec- 
tively, of said modulated carrier frequencies and which 
means, if this is true, notch filter said audio signal at 
the corresponding frequency band positions and insert at 
this frequency or at each of these frequencies, respec- 
tively, said carrier frequency or one of said carrier fre- 
quencies, respectively, and which means check at which can- 
didate frequency band positions in a frame following said 
current frame of said audio signal the energy or amplitude 
level of said audio signal is such that it can mask one or 
more, respectively, of said modulated carrier frequencies, 
and provide information about the locations of these fre- 
quency band positions; 

- Means for transmitting or transferring data of said cur- 
rent audio signal frame carrying said watermark data bits 
together with the information about the locations of the 
frequency band positions to be used in said frame following 
said current frame of said audio signal. 

In principle the inventive apparatus is suited for transmit- 
ting watermark data bits using a spread spectrum, said appa- 
ratus including: 

- Means for modulating said watermark data bits on an en- 
coder pseudo-noise sequence; 

- Means for modulating said modulated encoder pseudo-noise 
sequence on a carrier frequency; 

- Means for notch filtering a current frame of said audio 
signal at frequency band positions which are arranged in a 
pre-defined pattern across the sequence of frames of said 
audio signal, which means insert at this frequency band po- 
sition or at each of these frequency band positions, respec- 
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tively, in said current frame of said audio signal said car- 
rier frequency or one of said carrier frequencies, respec- 
tively; 

- Means for transmitting or transferring data of said cur- 
rent audio signal frame carrying said watermark data bits. 

In principle the inventive apparatus is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lated at encoder side on an encoder pseudo-noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
one of said carrier frequencies was inserted instead, and 
wherein a current audio signal frame carrying said watermark 
data bits was transmitted or transferred together with in- 
formation about the locations of the frequency band posi- 
tions used for said carrier frequencies in a frame following 
said current frame of said audio signal, said apparatus in- 
eluding : 

- Means for receiving and synchronising said transmitted or 
transferred audio signal; 

- Means for demodulating for a current audio signal frame 
said carrier frequency or said carrier frequencies, respec- 
tively, thereby using said information about the location or 
locations of the frequency band position or positions used 
for said carrier frequency or frequencies, respectively, 
which information was attached to the data for a previous 
frame of said audio signal; 

- Means for convolving said current frame of data of said 
audio signal with a time-inversed version of the encoder 
pseudo-noise sequence, which means determine from the sign 
of the peak or the peaks of the corresponding convolution 
result the value of a bit of said watermark data) . 
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in principle the inventive apparatus is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lated at encoder side on an encoder pseudo-noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
one of said carrier frequencies was inserted instead, 
whereby said frequency band positions were arranged in a 
pre-defined pattern across the sequence of frames of said 
audio signal, said apparatus including: 

- Means for receiving and synchronising said transmitted or 
transferred audio signal; 

- Means for demodulating for a current audio signal frame 
said carrier frequency or said carrier frequencies, respec- 
tively, thereby using the information about said pre-defined 
pattern; 

- Means for convolving said current frame of data of said 
audio signal with a time-inversed version of the encoder 
pseudo-noise sequence , 'which means determine from the sign 
of the peak or the peaks of the corresponding convolution 
result the value of a bit of said watermark data. 

Advantageous additional embodiments of the invention are 
disclosed in the respective dependent claims. 



Drawings 

Exemplary embodiments of the invention are described with 

reference to the accompanying drawings, which show in: 

Fig. 1 Watermark signal encoder and watermark signal decoder 

according to the invention, using spread spectrum 

technique; 

Pig. 2 Audio signal masking level -dependent sample pattern 
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showing which frequency group or groups in which 
frame carry a watermark signal; 
Fig. 3 Regular sample pattern showing which frame in which 
frequency group can carry a watermark signal. 



Exemplary embodiments 

In the watermark signal encoder section in Fig. l an origi- 
10 nal audio input signal AUS is encoded, or processed such 
that the masking level threshold information or the energy 
level information for an encoding is retrieved, using a psy- 
cho-acoustic model calculator PSYMC. The resulting masking 
level threshold, or energy level, information MLAUD for the 
15 audio data or its frequency spectrum coefficients (resulting 
e.g. from an FFT or MDCT) of a current audio signal input 
frame are fed together with related control data or coding 
parameters CTRLD to a watermark shaping notch filtering and 
embedding stage WATSFE. 
20 Input watermark data IWATD enter a bit value modulation 

stage BVMOD in which a current bit value of the IWATD data 
is used to correspondingly modulate a current encoder 
pseudo-noise sequence section ENCPNSEQ_i . For example, if 
the current bit value is '+1', the encoder pseudo-noise se- 
quence section ENCPNSEQ_i is left unchanged whereas, if the 
current bit value is '0' or '-1', the encoder pseudo-noise 
sequence section ENCPNSEQ_i is inverted. Sequence ENCPNSEQ_i 
consists of e.g. a 'random' distribution of '0' or »-l» and 
'+1'. The pseudo-noise sequence section ENCPNSEQ_i can have 
a length corresponding to that of the audio signal frames. 
However, if two different sequences ENCPNSEQ_1 and 
ENCPNSEQ_2 are used each of which has a length that is one 
half of the audio data frame length (of e.g. 4096 samples), 
two watermark data bits per audio frame can be transmitted. 
If N different sequences ENCPNSEQ_1 to ENCPNSEQ__N are used, 
each one of them has a length of 1/N of the audio data frame 



25 



30 



35 
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length, and N watermark data bits per audio frame can be 
transmitted. 

The pieces of watermark signals WATS resulting from stage 
BVMOD are fed to a frequency carrier modulator stage FCMOD 
5 wherein the watermark signals WATS are modulated on differ- 
ent frequency carriers f c i, according to the frequency bands 
used. 

The modulated watermark system depicted in Fig. 1 uses e.g. 

10 6 carrier frequencies in 6 frequency bands as depicted in 
Fig. 2. In vertical direction the number of the frequency 
band FB is counted. In horizontal direction the number of 
the audio signal frame FRMNO is counted, i.e. the horizontal 
axis represents time whereas the vertical axis represents 

15 frequency. At every time instant, i.e. in every frame, be- 
tween zero and 6 watermark signals can be inserted in the 
corresponding frequency bands, the number and location de- 
pending on the current masking level threshold or the cur- 
rent energy level . 

20 

In a subsequent watermark shaping, notch filtering and em- 
bedding stage WATSFE the output signal of stage MOD is com- 
bined with, or added to, corresponding frame sections of au- 
dio data. 

25 If the audio signal to be transmitted is represented in the 
time domain, the audio signal is notch filtered at the car- 
rier frequencies to be inserted, whereby the presence and/or 
amplitude of a carrier depends on the current masking level 
threshold or the current energy level of the audio signal. 

30 If the audio signal to be transmitted is represented in the 
frequency domain, the processing in stage WATSE is performed 
as follows. A current encoder pseudo-noise sequence section 
ENCPNSEQ_i is transformed into the frequency domain. In the 
frequency domain, this sequence is 'shaped 1 according to, 

35 i.e. its amplitudes envelope is made conforming to, the cor- 
responding frame section masking level threshold or energy 
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level shape or curve in masking level threshold information 
MLAUD. 

In case there are e.g. two encoder pseudo-noise sequence 
sections per audio frame, sequence ENCPNSEQ_1 is shaped ac- 
cording to the masking level shape or curve in the first 
half of the audio frame and sequence ENCPNSEQ_2 is shaped 
according to the masking level shape or curve in the second 
half of the audio frame. 

The frequency domain audio signal is notch filtered at the 
carrier frequencies to be inserted and the corresponding 
carriers are inserted instead, whereby the presence and/or 
amplitude of a carrier depends on the current masking level 
threshold or the current energy level of the audio signal. 



For example, the audio signal to be watermarked at time in- 
stant 2 has only in the frequency band 3 enough energy to 
allow for an inaudible embedding of a watermark signal car- 
rier. In a prior art watermark signal extractor all 6 bands 
must be decoded only to find that five of them do not -con - 
20 tain any watermark signal. 

As mentioned above, in some applications a delay of the 
length of one watermark data frame is acceptable. According 
to the invention, the psycho- acoustics relevant for audio 
data frame 2 can already be calculated before the watermark 
signal carriers for audio data frame 1 are inserted. As a 
result it is signalled to the decoder during the audio data 
frame 1 period that in audio data frame 2 frequency band 3 
only will be occupied by a watermark signal carrier, and the 
decoder will decode this single band only. During the audio 
data frame 2 it is to the decoder that frequency bands 1, 2 
and 4 will be occupied by a watermark signal carrier, and so 



on, 



35 



A watermark 'packet' is formed in stage WATSFE or in stage 
TRM, or in a non-depicted controller, from the watermark 
signals of several frames, each one of which frames carries 
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one bit per frequency band used for a watermark signal (if 
there is used one encoder pseudo-noise sequence per fre- 
quency band) . A watermark packet carries several bits of 
which one or more are used for signalling the occupation of 
the frequency bands in the, or a, following audio signal 
frame . 

In a different embodiment, the feature of signalling in ad- 
vance the future -occupied frequency band or bands is not re- 
quired. A pre-determined pattern of differently occupied 
frequency band or bands in different audio signal frames is 
used, e.g. a regular pattern like that in Fig. 3. Thereby in 
each audio signal frame the same number of frequency bands 
is occupied, e.g. one or two per audio signal frame. The 
above-mentioned stages do not include the signalling infor- 
mation in the watermark packets. Because of the regular pat- 
tern and the irregular audio signal masking level threshold 
or energy level threshold, either all watermark signal car- 
riers have an equal low amplitude, or have different (i.e. 
adapt ive ) ampl i tude s . 

The output signal of stage WATSFE passes through transmitter 
stage TRM (which includes e.g. a D/A converter and/or an am- 
plifier) and channel WATAUTRMCH to a watermark signal de- 
coder or receiver. 

Unintended, in the watermarked audio transmission channel 
WATAUTRMCH a noise or reverberation or echo signal NRE is 
added. This channel can be represented by an acoustic con- 
nection between a loudspeaker and a microphone. 

In the watermark signal decoder section in Fig. 1 the dis- 
torted transmitted signal enters a receiver stage REC, 
wherein e.g. a coarse synchronisation and/or an A/D conver- 
sion is performed. Its output signal passes via a bit or 
fine synchronisation stage SYNC and a band filter and de- 
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modulator stage BFDEMOD to a data recovery matched filter 
stage BFDEMOD, or time-Inverse convolution stage DRECMF. In 
stage BFDEMOD the carrier-modulated watermark signals in th« 
different frequency bands are demodulated using a carrier 
frequency f ci corresponding to that used in stage FCMOD in 
the watermark signal encoder. Also, the above-mentioned sig- 
nalling information contained in the watermark packets is 
retrieved in case no regular pattern-occupation of frequenc} 
bands was used. Stage BFDEMOD convolves, or filters, the 
carrier-demodulated watermark signals of a current incoming 
audio frame coming from stage BFDEMOD with a decoder pseudo- 
noise sequence ENCPNSEQ_i that is pre-known by, or stored 
in, the decoder and is time-inverse to the related encoder 
pseudo-noise sequence section ENCPNSEQ_i. Basically, a cor- 
rectly transmitted watermark bit -appears- as a peak in the 
middle of the 2*N-1 intermediate correlation results. How- 
ever, due to echo signals a peak could occur at the same or 
a different position. 

In case e.g. two orthogonal encoder pseudo-noise sequence 
sections per frequency band per audio frame were used in the 
watermark signal encoder, sequence DECPNSEQ_l is convolved 
with the first half of the corresponding frequency band sig- 
nal and sequence DECPNSEQ_2 is convolved with the second 
half of that frequency band signal. 

Stage DRECMF provides the watermark signal decoder output 
watermark data OWATD which correspond to the input watermark 
data IWATD, 

The pseudo-noise sequences used are calculated by a given 
algorithm based on a start value. In order to transmit se- 
cret watermark data, the start value or even that algorithm 
can be encrypted and transmitted to the watermark signal de- 
coder wherein it is used to calculate the decoder pseudo- 
noise sequences DECPNSEQ_i and the modified decoder pseudo- 
noise sequence MDECPNSEQ. 



EPO-BERLIN 
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Claims 

1. Method for transmitting watermark data bits (IWATD) using 
a spread spectrum, said method including the steps: 

- Modulating (BVMOD) said watermark data bits on an encoder 
pseudo-noise sequence (ENCPNSEQ) ; 

- Modulating (FCMOD) said modulated encoder pseudo-noise 
sequence (WATS) on a carrier frequency (f c i) ; 

- Determining (WATSEP) whether at one or more different 
candidate frequency band positions in a current frame of 
said audio signal the energy or amplitude level of said 
audio signal is such that it can mask one or more, re- 
spectively, of said modulated carrier frequencies (f c i) 
and, if this is true, notch filtering (WATSEF) said audio 
signal at the corresponding frequency band positions and 
inserting (WATSEF) at this frequency or at each of these 
frequencies, respectively, said carrier frequency or one 
of said carrier frequencies, respectively; 

- Checking (WATSEF) at which candidate frequency band posi- 
tions in a frame following said current frame of said au- 
dio signal the energy or amplitude level of said audio 
signal is such that it can mask one or more, respec- 
tively, of said modulated carrier frequencies (f c j.) , and 
providing information about the locations of these fre- 
quency band positions; 

- Transmitting or transferring (TRM) data of said current 
audio signal frame carrying said watermark data bits to- 
gether with the information about the locations of the 
frequency band positions to be used in said frame follow- 
ing said current frame of said audio signal. 

2. Method for transmitting watermark data bits (IWATD) using 
a spread spectrum, said method including the steps: 

- Modulating (BVMOD) said watermark data bits on an encoder 
pseudo -noise sequence (ENCPNSEQ) ; 

- Modulating (FCMOD) said modulated encoder pseudo-noise 
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sequence (WATS) on a carrier frequency (f c i) ; 

- Notch filtering (WATSEF) a current frame of said audio 
signal at frequency band positions which are arranged in 
a pre-defined pattern across the sequence of frames of 
said audio signal and inserting (WATSEF) at this fre- 
quency band position or at each of these frequency band 
positions, respectively, in said current frame of said 
audio signal said carrier frequency or one of said car- 
rier frequencies, respectively; 

- Transmitting or transferring (TRM) data of said current 
audio signal frame carrying said watermark data bits. 

3. Method for regaining watermark data bits (IWATD) embedded 
in a spread spectrum, whereby the corresponding original 
watermark data bits were modulated (BVMOD) at encoder 
side on an encoder pseudo-noise sequence (ENCPNSEQ-1 . . -N) 
and said modulated encoder pseudo-noise sequence (WATS) 
was modulated (FCMOD) on a carrier frequency (f c i) » 
and wherein at one or more different frequency band posi- 
tions in a current frame of said audio signal the audio 
signal was notch filtered and one of said carrier fre- 
quencies was inserted instead, 

and wherein a current audio signal frame carrying said 
watermark data bits was transmitted or transferred to- 
gether with information about the locations of the fre- 
quency band positions used for said carrier frequencies 
in a frame following said current frame of said audio 
signal, 

said method including the steps: 

- Receiving (REC, SYNC) and synchronising said transmitted 
or transferred audio signal; 

- Demodulating (BFDEMOD) for a current audio signal frame 
said carrier frequency or said carrier frequencies, re- 
spectively, thereby using said information about the lo- 
cation or locations of the frequency band position or po- 
sitions used for said carrier frequency or frequencies, 
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respectively, which information was attached to the data 
for a previous frame of said audio signal; 

- Convolving (DRECMF) said current frame of data of said 
audio signal with a time-inversed version 
(DECPNSEQ_1. . .N) of the encoder pseudo-noise sequence; 

- Determining (DRECMF) from the sign of the peak or the 
peaks of the corresponding convolution result the value 
of a bit of said watermark data (OWATD) . 

4. Method for regaining watermark data bits (IWATD) embedded 
in a spread spectrum, whereby the corresponding original 
watermark data bits were modulated (BVMOD) at encoder 
side on an encoder pseudo-noise sequence (ENCPNSEQ-1 . . .N) 
and said modulated encoder pseudo-noise sequence (WATS) 
was modulated (FCMOD) on a carrier frequency (f c ±),, 
and wherein at one or more different frequency band posi- 
tions in a current frame of said audio signal the audio 
signal was notch filtered and one of said carrier fre- 
quencies was inserted instead, whereby said frequency 
band positions were arranged in a pre-defined pattern 
across the sequence of frames of said audio signal, 
said method including the steps: 

- Receiving (REC, SYNC) and synchronising said transmitted 
or transferred audio signal; 

- Demodulating (BFDEMOD) for a current audio signal frame 
said carrier frequency or said carrier frequencies, re- 
spectively, thereby using the information about said pre- 
defined pattern; 

- Convolving (DRECMF) said current frame of data of said 
audio signal with a time-inversed version 
(DECPNSEQ_l. . .N) of the encoder pseudo-noise sequence,- 

- Determining (DRECMF) from the sign of the peak or the 
peaks of the corresponding convolution result the value 
of a bit of said watermark data (OWATD) . 

5. Apparatus for transmitting watermark data bits (IWATD) 
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using a spread spectrum, said apparatus including: 

- Means (BVMOD) for modulating said watermark data bits on 
an encoder pseudo-noise sequence (ENCPNSEQ) ; 

- Means (FCMOD) for modulating said modulated encoder 
5 pseudo- noise sequence (WATS) on a carrier frequency 

(f ci> ; 

- Means (WATSEF) for determining whether at one or more 
different candidate frequency band positions in a current 
frame of said audio signal the energy or amplitude level 

10 of said audio signal is such that it can mask one or 

more, respectively, of said modulated carrier frequencies 
(f c i) and which means (WATSEF) , if this is true, notch 
filter said audio signal at the corresponding frequency 
band positions and insert at this frequency or at each of 

15 these frequencies, respectively, said carrier frequency 

or one of said carrier frequencies, respectively, 
and which means (WATSEF) check at which candidate fre- 
quency band positions in a frame following said current 
frame of said audio signal the energy or amplitude level 

20 of said audio signal is such that it can mask one or 

more, respectively, of said modulated carrier frequencies 
(fci) ' and provide information about the locations of 
these frequency band positions; 
- Means (TRM) for transmitting or transferring data of said 

25 current audio signal frame carrying said watermark data 

bits together with the information about the locations of 
the frequency band positions to be used in said frame 
following said current frame of said audio signal. 

30 6. Apparatus for transmitting watermark data bits (IWATD) 
using a spread spectrum, said apparatus including: 
Means (BVMOD) for modulating said watermark data bits on 
an encoder pseudo-noise sequence (ENCPNSEQ) ; 
Means (FCMOD) for modulating said modulated encoder 

35 pseudo-noise sequence (WATS) on a carrier frequency 

(fci); 
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Means (WATSEF) for notch filtering a current frame of 
said audio signal at frequency band positions which are 
arranged in a pre-defined pattern across the sequence of 
frames of said audio signal, which means (WATSEF) insert 
s at this frequency band position or at each of these fre- 

quency band positions, respectively, in said current 
frame of said audio signal said carrier frequency or one 
of said carrier frequencies, respectively; 

Means (TRM) for transmitting or transferring data of said 
10 current audio signal frame carrying said watermark data 

bits . 

7. Apparatus for regaining watermark data bits (IWATD) em- 
bedded in a spread spectrum, whereby the corresponding 
15 original watermark data bits were modulated (BVMOD) at 

encoder side on an encoder pseudo-noise sequence 
(ENCPNSEQ-1. . „N) and said modulated encoder pseudo-noise 
sequence (WATS) was modulated (FCMOD) on a carrier fre- 
quency (f c i>, . 

20 and wherein at one or more different frequency band posi- 

tions in a current frame of said audio signal the audio 
signal was notch filtered and one of said carrier fre- 
quencies was inserted instead, 

and wherein a current audio signal frame carrying said 
25 watermark data bits was transmitted or transferred to- 

gether with information about the locations of the fre- 
quency band positions used for said carrier frequencies 
in a frame following said current frame of said audio 
signal , 

3 0 said apparatus including: 

Means (REC, SYNC) for receiving and synchronising said 
transmitted or transferred audio signal; 
- Means (BFDEMOD) for demodulating for a current audio sig- 
nal frame said carrier frequency (f c i) or said carrier 

35 frequencies, respectively, thereby using said information 

about the location or locations of the frequency band po- 
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sition or positions used for said carrier frequency or 
frequencies, respectively, which information was attached 
to the data for a previous frame of said audio signal; 
- Means (DRECMF) for convolving said current frame of data 
of said audio signal with a time-inversed version 
(DECPNSEQ_1 . • .N) of the encoder pseudo-noise sequence, 
which means (DRECMF) determine from the sign of the peak 
or the peaks of the corresponding convolution result the 
value of a bit of said watermark data (OWATD) . 

8.. Apparatus for regaining watermark data bits (IWATD) em- 
bedded in a spread spectrum, whereby the corresponding 
original watermark data bits were modulated (BVMOD) at 
encoder side on an encoder pseudo-noise sequence 
(ENCPNSEQ-1 . . .N) and said modulated encoder pseudo-noise 
sequence (WATS) was modulated (FCMOD) on a carrier fre- 
quency (f c i) , 

and wherein at one or more different frequency band posi- 
tions in a current frame of said audio signal the audio 
signal was notch filtered and one of said carrier fre- 
quencies was inserted instead/ whereby said frequency 
band positions were arranged in a pre-defined pattern 
across the sequence of frames of said audio signal, 
said apparatus including: 

- Means (REC, SYNC) for receiving and synchronising said 
transmitted or transferred audio signal; 

- Means (BFDEMOD) for demodulating for a current audio sig- 
nal frame said carrier frequency (f c i> or said carrier 
frequencies, respectively, thereby using the information 
about said pre-defined pattern; 

Means (DRECMF) for convolving said current frame of data 
of said audio signal with a time-inversed version 
(DECPNSEQ_1. . .N) of the encoder pseudo-noise sequence, 
which means (DRECMF) determine from the sign of the peak 
or the peaks of the corresponding convolution result the 
value of a bit of said watermark data (OWATD) . 
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10 



9. Method according to claim 1 or 2 or apparatus according 
to claim 5 or 6, wherein the power or amplitude level of 
said modulated carrier frequency or frequencies (f ci ) is 
made such that it is masked by the energy or amplitude 
level of said audio signal at the corresponding frequency 
or frequencies, respectively. 

10 Method according to one of claims 1 to 4 or 9, or appara- 
tus according to one of claims 5 to 8 or 9 wherein, with 
respect to a watermark signal carrier-occupied frequency 
band in the current audio signal frame, in the following 
audio signal frame no watermark signal carrier is trans- 
mitted in the frequency band corresponding to that occu- 
pied frequency band. 
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23 EPO-BERLIN 
Abstract 1 1 -12- 2003 

Spread spectrum technology and the related inserted or added 
information signal can be used for implementing watermarking 
5 digital audio signals. A known processing for retrieving at 
receiver or decoder side the watermark signal information 
bit from the spread spectrum is convolving the received or 
replayed spectrum with a spreading function that is time- 
inverse with respect to the original spreading function. The 

10 pseudo noise sequences are modulated one or more carrier 
frequencies which are inserted at one or more frequency 
bands into the spectrum of an audio signal . The watermark 
signal decoder checks the frequency bands occupied by such 
carriers. According to the invention, the frequency band oc- 

15 cupation information is signalled in advance, i.e. is trans- 
mitted already together with the frame data for the current 
frame, such that the watermark signal decoder knows before 
processing the following audio signal frame which carrier 
frequency or frequencies are occupied and must be used for 

20 the corresponding carrier demodulation, and which carrier 
frequencies need not be checked and demodulated. 



Fig. 1 
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